Skip to content

Add per-LLM generation config overrides to X-Config header#33

Merged
ChengZhang-98 merged 3 commits intomainfrom
ed/add-per-llm-generation-config-overrides
Mar 12, 2026
Merged

Add per-LLM generation config overrides to X-Config header#33
ChengZhang-98 merged 3 commits intomainfrom
ed/add-per-llm-generation-config-overrides

Conversation

@dedeswim
Copy link
Contributor

Summary

  • Adds GenerationConfigOverrides, ReasoningConfigOverride, and LlmOverrides models to FineGrainedConfigHeader
  • Enables per-LLM generation config overrides (temperature, reasoning, max_completion_tokens, etc.) via the llm section of the X-Config header
  • Mirrors secure-orchestrator PR #392

Usage

from sequrity.control import FineGrainedConfigHeader, LlmOverrides, GenerationConfigOverrides, ReasoningConfigOverride

config = FineGrainedConfigHeader(
    llm=LlmOverrides(
        pllm=GenerationConfigOverrides(
            temperature=0.5,
            reasoning=ReasoningConfigOverride(enabled=True, effort="high"),
        ),
        rllm=GenerationConfigOverrides(max_completion_tokens=512),
    ),
)

Test plan

  • 7 new unit tests for serialization, reasoning config, multiple LLMs, None exclusion, deep merge, and strict validation
  • All 34 header override tests passing

🤖 Generated with Claude Code

Mirrors secure-orchestrator PR #392: the X-Config header now supports
an `llm` section for per-LLM generation config overrides (temperature,
reasoning, max_completion_tokens, etc.).

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@dedeswim
Copy link
Contributor Author

Fixing linting issues asap

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
default=None, description="Grammar-constrained LLM generation config."
)
qllm: GenerationConfigOverrides | None = Field(default=None, description="Query LLM generation config.")
tllm: GenerationConfigOverrides | None = Field(default=None, description="Tool-formulating LLM generation config.")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tool-formulating -> tool filtering

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed!

@ChengZhang-98 ChengZhang-98 merged commit bde8919 into main Mar 12, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants